Task Complexity measurement in the evaluation of Spoken Dialogue Systems

Spoken Dialogue Systems (SDS ́s) is a technology that provides users with a speech based interaction with machines to carry out several activities in the pursuit of their goals (information retrieval, business transactions, automatic translation, etc.). Development of this kind of systems needs an evaluation process to show the real system performance, to identify implementation errors, etc. The resources to carry out this process are few, and for most of them their functional capabilities are constrained and not so general. This paper presents an approach for measure the Task Complexity on SDS. The description of the approach is carried out to show that this is one of main factors that should be considered in order to develop a consistent and general enough evaluation framework for SDS ́s. Key-Words: Spoken Dialogue Systems, Evaluation Framework, Task Complexity.